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(57) [g^] 

W FJi/JBIH+CC-rf v 9 FfcWHrr*'<HT h^- F*tt 

©SWiTtt* liW3>;q;i/f^*/y? F#— o«± 
•ttttT£C *SS8«T«, — 3*CDn>'W 




1 

yy-y Ktt, fufBr^b^-^y'n^A^^gftTte 
=J- F*$«fctf:3>'W jUjgr^ny^Ara — K (OWJfS^M 

^^ay^AK«BirS»l<DU^ h*r#IH3*T.. Iff 

tarn i^v? Ktt. ButB^ i y x hicttm? zmm&ft 

MtiLJVv FT**, l»*^llSi8©=i>f^-^{cJ: 

[ it 3 ] mtm$st<Ds y * f* 6»r $ ft am i 
<D—m<Ds y * Ftt» i©'jxf (tcttmu , m&m&v 

MVv TrfrhWSRZtl&mCD— fflCD^y v F«SI2© 
BUIB0 MV«; FSSKSOTSX-r * HUlBffl 1 U X 

h * hmmmzm&j v ? f <t u tbiest i^v?fs 
[ 4 ] mnm$k<Ds y ? f*p snswi 

<D-ffl<Z>y y ? FB» KD'JX h tcffiU, lJifE«»<D 
^V-; F*>e>aJRSftSS2©— «©y V* F«3I2<D 
yxKcftGSU SuEStl 'JXHJItiEa^fa-^^ 
n^^ACD^Stfjtc^^n, «TE»2 "J* HrtilE=i 

yfa-^f^D^A {C 3 ft , 

llyEJg WV>; FSrKUMTSXf^ ituE^I 2 U X 

Frt>6*Wff5teJIHffi-rf y * Fi LTgfflB» IMW F£ 

[»3t55 J WEail-rfV* F<3Dn>/W;l/<DflJSB{b 
mcmu n > f * - * y'u a tc J: o r fUiA^^ff 
S ft fc £ ^> * * *JJ St T 4 * -r *;> y * t s 

mftam uv? F©a >^<-fii/w«iEBfse«FiH<Dsaia 



(2) mmW- 1 1 - 2 3 7 98 9 

31 1 -4 CDC>maHCiBtgOO:3 >fa-^ tCcfc oT§«E 
£ft£^£ 0 

or, 

WEfiT ^r^tr^ JlfllB X ^ » k 

S^O^ y F^P6«JRSn5» 1 y ^ F£gnB& 

etrismi ^v? F*s3>^^-f;i/Snrt>tti^<k*ij»fSft 
tcrn-sic , Hutaffir ^t'f wwcftc Butam i * y 

20 [a*3S7] SJIB^iyy v F^ra>^NV;U$n/ci 
«K3ti/c»^CC. Hutaa»<D^ v-^ F^6StRSn-2> 
*2©^v ? F*WEfir t:f"-f JHFB^CCllBiJ-r 

SuIBgl 2 ^ y FjW ^ ^ ;u 3 titcfr E 5 *i4*iJKT 
^>Xf '>7'^ot, f5fB^2j>*y? F*S3>/\ViUS 

tcm&ic, tuiafir ^^t'f^ xan^ccffisesi 2 y y 
6 f m<o 3 > t-* - £ tc j: -o r mm s n 4^ 

So 

C»3KB8 ] fjia«IS<Z)^ y v )F<Dgr*? Idtfb-C&ft 
FtfiHOBM FCc*t-r4HJEff5felBfil[fflK:ar5t^ 

T»ga $ ti hmm 6 s /el* 7 12JK© a > - ^ cc ct 

s^ifii^t^xf^u, itria«a©yy^ f 

^sia^cD^^ti^-^tCct^riiss^ft^^ao 

0] WEiitt©yy ^ F©#^r«c»L/ri9 

f ^? cc jptr 4 3 > ^ -r ;i/8$p^ ^ fj f a<s r^r^t'f 
'<«8P B W^}tS*r4XT*^y , ^^"CC^, »*^8ia 

[«*^ 1 1 ] tuE«»oy y F^^ajRSftss 

1 OHBO ^ V 7 1 (D y X h tcfti L . SulBSI^ 
50 CD^y^ Ffr£»tRSft5S2©— ffl©>* V * FttS2 



3 

<du* hKttffiu fufasn y* h«fiie^>f^-^ 
y*D^7ACD&s*K£^3^ fii2m2 y* htatsB 
3 > b ^ - * y*n ^5 AOfflll k£j53 h, 
we* \*vv FrtJitsxf9 lutein 1 »J X 

Ffr 6*SflBfcJ8ffi->< V 9 F<t OTfulBSg lyy^K* 
it&lcmiZ a > b" * - * 7' a #5 Ate <fc -o T«G&4rt*X 

fTlB* K03>^^j|/WIIIBBfje«flRI©liaa 

316—1 l(Di>rti*>tci3Koa>b-A-^K:J:oTSI 

lutein y v F^ssiaffir * r -r t-f * wra^tca > 
<JESB2yy ? F#:a>'^i'3ttTi>tti><t^JK3tt 

ii3IB{£7*f*4 tf^MIH^OClftR^^ V 

£7^ F^ffllB*cciK^x^*«W9«:«i«rsA:«>ec 
n>b # *-^tc<to'r*Sfisn4*ffir*^r, 
itfilBn > b * - £ ^-n a<d#ls&c*>w %>t 4 fjHW 

^<&*x**>e>iKR3ftsm <D*x#«rSuE=i>b 

7'a^Afct:, BSRSr^n^Ari- F*5«fcCF:a>'W 
;^7'd^7A3- F©a^*l6tfrSJ:9Cc:«aE3n 
Tt>&Xf 

.Btiami ^^ItSt^r^'r^ot, fulBfSl 
[ J*#E 1 5 ] h/cig^tcWEW 1 * 



(3) «fH¥ 1 1 - 2 3 7 98 9 

4 

[»3#I 1 6 ) ti/c*&ec«TE» 1 * 

X*£*»r-r£Xir ? 1 4IBfS<D 

[ff^i7] n^b^-^y'o^AOMSCtfctt 
&ffi7*<r -/ iffwJBIH^fcrc-f hn- Kft^v ? F£ 

E^v? FttH5sB=3>b^-^7'ci^7A(c«Blurfc 

[»«3i 1 8 ] -piaa»©^ v * pom i 

JHT4«t5«C«JiJESti. HUlB^b^-^n^AK: 
VISITS* 1 <D y^-hTAot, iirKSU^y * F#t 

i y ^ h tcttiss-r ssi^ffistMa^ v ? pt&ot 

20 fMB«»<Dy V y F 2 (D— iffl£#Hrr ^> J: ^ cc«fiE 
3tiA:*2©yx FT*-?T, mrfan>b**-^y'a^ 

SJIB^l y X h^fulB^>b*ju — ^y'n ^7A0^1$ 

" K:*jffisn&Biac3ii 7ia*8©3>b*-^^xf-A 0 

UV? F©3>^-/il/*JT%W*J:^CC*aj3n/cfT 
[ISSt®2 0 ] iuE^l ^ V ^ F^n>^^;U3n^> 

'!»5R3Bi 7-i 9©ii-rn^ia*fco3>b A -^^xf 

A e 

[11*312 1] ^>b^-~^y , n^^AC7)^^fc^ 
40 S7-f FjMBH^k:-* F^ttfiftn>^N--Y;w*r^J:^ 
CClfg<;3n/cn>b^-^y , ay^A3- F^g (comp 
uter program code device) ^r'&tfn > t'a — t^^IRO 

Buiar^ F;ufflHi*»sijr^3>b- A -^^u^A=i 

ffl»©yy F3^6iBtRSn*»l<D>y ^ F**E7 
-f F;i/»!Mtptc»g(|'r 53>t'a-^7'n^7A3- F 
Sir^ot, fufB^^oy y ^ F^suian >b^-^ 
y*n a * nr c >2> ^ > b ^ - 5 y'u a 3 - 
50 F««<h, 



(4) 

5 

[if 3}cig2 2 3 lusB3>f*-^^ay^ A3 - F» 
[0 0 0 1 ] 

3S< tiT £ # ffifc <fc BUT £ B 

[0 0 0 2] 

%rc-f hn- Filt3>fa- £->*f-Ak:ffifi$ft 30 
[0003] 3>b-^-^^n^5A^s*fi!to5:Jf^r 

-7-»=3- KCCfflK$n^7'a^^Aci:0fc3>fc- 
^-^^x^Ai^r^fe^^^-^^^c^ 

flajg»S?3ft£:/u^5A«:, fcl>Tl>(D»&, 
FfcHRSftS^cz^AJ;*) fcMfiig^ 
jll> 0 CCDtcib, 3>fji- A^Vv^rn- 40 

[0004] 

y y F£n>;W;UT&C ctT>&£ 0 C(D77*D-f 
tt. U*L/«»W3>MVil/*tett r|Hf«F (runtim 
e) J 33>^-Ol/£i¥tfft5. tttoaW^-OWCti^ — 50 



ftffi¥ 1 1-237989 
6 

Pflfi , y* a ^ 5 A frc# o n > -f ;ix * - ; ^ ? 

y*P ^A<D3>^JUCC{$5*-^ 
F#. ^o^5A©^*W&lltT«:ffl»»?:^4 

A«aa*figfflL-raf&i, ^n^^Acoigtf^fisa^r 

^^A<D»ftc^< nJtete#4>£. ?o«A 
Atcnv> FSrA^rst, 3.— !f A*{c*rt"SJS§K: 

[0 0 0 5 ] 

cD{togft£3iJ&T&/ctf>, ra>b :*-£:7*a^A<D 
H?ftc4$wsT^ F;UR8PJ]4Hcy v ? F*«pW=i»<-f 

F©5R***?TrS<t^CC«JS£3n/c3>b^-^^^ 

cfcfttf, n>b^-^^n^^AO®stcfc^^>T^ F 
JHHIB*fcttiS*-^^y Ftmawustis. ceo 
SL n>^'-<;l/fflK:^glJ3n/c— o«±(D^V > F#C 
cDf&giJS ft /cT-T F;uJHIB*cc«itt3>yw^stiS. 
— 8B©S8«r«. ttft3>^-Ol/§ft&^#yy ^ Vifi 

—~?&Lt<Dvx 

[0 00 6 ] *sa8«-c», yvv F©3>/<-<;nptc 

[ 0 0 0 7 ] #»W©KCCgrj©!B«-ctt, n>b'^-^ 
^a^A<D®Stc*5t^-5>®Td7^^ \Z7 j MBytes* 

<Dzi>jH)\,<Dtc#><DJV v F*»giJ-r-&«»*MtcS 
JK^v? K©3>^^JU*«rjJWftr-5J:5«c«fiSSft 



+ 4 



k to n > / w n^tgft $ ti/ctwa*e#*ftrar & <t 

[0 0 0 8] **?8©±IB3bJ:tf«©*JjStt. «T©f£ 

[0 0 0 9] $:^0J«, Sstt©^®£ £ feCCfelT©SMB 
*#lfit S c i jcJ: otft tfi < lists c t *«r * 

[0010] 

A«$l©j®g©<£ffl, rttbftaWW^*-^*^* F 
A^fcptcy V F^rtbffjn^W JUL/TC^Sn>yNV 

*S**J2 0 0 ^ y»*jHjL4) C©i:5&iI3i 

[0 01 l ] c©±5&:/n4^A©ffij|©a#ccJtf-r 
S-od)7^D-?tt, JWRSF'W F=»- Fte«fcOT*W 

r&& 0 cOcfc^^^^-f-A-rti, 4*jE©-*v f * F©3 

K^JteffJWO <b *«c .n > fcT * - £ :/a ^ A 
SffijWffiKSft*. «fCC % a>^-f Jl/*- F*«* 

[0012] a>^;i/;WTSSftri>s4>tt< ifc— 

ffitwK.;Fii ( — «lcJtjKEj{8c>. c©<fc5tt<ET 



5) 1 - 2 3 7 9 8 9 

8 

[00.13] iWl^il. F=3-F©ttW 

©— sasjgatcffio-cBttwrs. >uh*-fi44 

Fl 4 4ti/ (EEv^>rt©JHKB$WK (conpile-time 
environment) CC J: oTIal &{Kffi"^>rt©3Hf8SIft& 
C run-time environment) . Wx.^2>b'a-^^Xf 

A 1 4 6 tCffi^T S C ijW-C* 4. *»»*3aireJ«tt 

[0 0 14] ha-F 1 44^3>fa-^^f 
Al 4 6tC#x.?>n/ciS^, Fa— F 1 4 45:4 > 
20 * 1 4 8tecfcoT^T£C<fc#T#a. 

Wi, ^Wh3-Fl 44?:3>A>f7 1 5 OtCctoT 
3>^VJHt, rar^-OI/jfr^-f F 1 5 2£fE 

^EL/Tfecfct^ — A>f F3-F14 4tt % #>ffl© 
fcfttC-Odr-^y £ 1 4 8fcJ;^3>;W7 1 50© 

[0015] ^V-; KOSPWaLW, J V F#3 > 
'*<f F«Cf*9'W ha- F 

1 4 43&s-f>^-^y ^ 1 484ffi^rWW3tlS. * 
43a»BttTtt. F3W)WliSnSB«©ft 

[0 0 1 6] y v?p F3&sWKShSH**«0#l»ffl. T 

lSO^raWWWCi^S. JWR»^ 
^3-F154tt, — «tC=i>^VJUar=i- FcfcO 4> 

jafaKswit^ -rtt*>%#»»*«rr**©T..«»K: 

^ff 3^1^33— F (frequently executed code) 1 5 8 

;u^-^^ F*»fltr.4^HES***t^©-c. -HBBc, 
«SKI^f3- F 1 5 8 5:=J>7W;l/T4C£r, ffKH 
fT=i-F-l"5 8«:jl3!I<tStlteyV9 F*J:0S»«ft< 

[0017] Hff^Oia,.3>^'f7 1 5 0^ffl^/cA' 
-f h3-F14 4©=3>>'^'r^^C^ ; !>a>vS^;i / ^^^' 
Ftt. C©a>A-OM--><^? F*ailt^»E* 

so 6nsf^gi/^j^jSi^ta^ca$n^' c 



9 

o^— fe> htt^^-ccDjEHrtt-r^ci^r^So >< 

<Y ha- K 1 4 4(D3>^jbtc#5r-'^* F#C 

F# fcoi ffiwtitf 3 >/* -Y ;i/ S nr^/cr^ 5 5 > v 

-Obtf— F#«fcDffilr>£#«: % *ff y^h*©^ 

#9£lt1M"-'^* Fi<D5R#*HSU^l''C*S«F*c 
[0 0 1 8 3 ><-{F:a-F;W, ^P^^AO^ttfl^tr 

urfecfc^o yctcH2 4#«iT«>i, :/p^a, rft 
3- F*3>MVJi/-r5aiB*^-Cl^. COD^P-fe 
<^fftt^f-^2 1 03^6*6* Xf7^*2 12T 

[0 0 1 9 ] 7-f FJi/WIHtt, — ^a^A^t 
WxtfK#ffcit (think pause) T£>£ 0 :7*P^A 
3 >^fA^6^^ vff-5f& £(DT ^ 3 >&w->x 

«*K. 74 F;i*8W<DfiStt, tor 
&0L S U #*> 6tt 2 1 T» t T s t £ # * * . 
?*p 95 J*ifia-ViPhOJ<fr&W^X\<*ZfclblZ.T 4 
F;MBR8#£D&ig^fck HBCcr-Y FjUJBIH#««>T 

[0 02 0] HWC % r^ffflj «cf*±*B«TSfcftCC 



(6) 1 1 -2 3 7 9 8 9 

10 

Srffifflr 5 /cat) «c a > -f ji/* #a«fc9Kit/tfe 

fir^f^f ^©wu^^i (mar. shoo 

[0 02 1 ] — fiftCC, 7 4 FJl/JHIBL rato%th«wr 

#5**«ka«S« (CPU) ©«!S*4K»rsc4K: 
io ctorfilJSUT^ci*«r*s. come, ^n>t:^>- 
^^fAtcfl^u^ F©«JBS:KaTSC<i:*cj:o 

[0 02 2 ] fB>tflft 4 >7 ^f" a \ZT J ( relative ina 

ctivity) a>wn*Bffliirsfc«>«:cpu««*3W»a 

20 (MAtf. *-v^*H)HWCc9B«raj:^ cesser * 

7 4 F^-C**i*a3n5J:5Ccl9:5ErsCi^T?# 

JB*^^Xf-A««C[)jKj2 0'<— fe> h il^ffiffi* 
0#t>fiI3:T[H]££, ^P^^AO^fr^S^tST^T^ 

tt, VXfAJHlC!)il>&< ifcjK?8 0^— b>h*s«6ffl 

[0 02 3] S«»T*tlia»r#ftJ:5«:. ^U-; 
30 F©t«Bc0iaacctt % Fxer^ A --7©*IW (st 

udvinq) C 43^*5. F^n 

^StifcCi, tftMJBMlcSO^i/? Ft 
ffnJtE (run-able) J tt«3B(C&l>C £4* U ? KX^r 

t»rt>, «ws«rrs*-cBj«»snttc^ cpum 

40 [0 0 2 4] ^P^^AQ^T-f FiW^C^C^ 
Xf^2 1 2-C4mtKSft£<t. 
^7*2 1 Oicm*), C Ct7'P^ Att»f?*iRW ^ e 
CtDtttoOCt^T-Y F^SBPa^feSiXT- -j/7'2 1 2t 
WVKZtlZt, ^>J*>()ltj:£<D&'gZZ2 (pendinq 
task) ifi&&rZ>tif>£ ^MCKltXf v 7*2 1 4tfl 

(Wttsns. r/jrto^, r-r Fii/JBPfl4»tc«feric 

50 ©Jr^tt^^^tctt. cne»CD^7^(D^fArtT0 



11 

[0 0 2 5 } — ffitfrC, gg3>;WW ro©V-^ 
SET*— o<D»J5Wctt % 3>;w;b»yy? F*KftT 

[0 0 2 6 ] _b3i<D<t^CC, H?f FB, y'a^A 20 

ffUXhB, yy? F©:a»*-( ;i/^nJ#gcc*r^K:»^ 
tcmmic <fc o r ^ > ^ e> WW s tir i y y ^ f 

to^yy v FsWI(RS"*ifcia»«ciBBr**'>>*, * 
l&ftT&ifciX -f — >^y*n*teX (separate sweeper pro 
cess) CCcfcoT UX FCCJERBWtCilJjDSti/cyy ? F£ 30 

aauon^Ttj:^. hbkc, ^v? f/bowhls&'J 

>*B. yy * FWcXffiStiS/cc^tcft^sn^o ^ 
>£2»\ yy? F*.3>^Vii/tca«J<b*3ter/c*K:3g 

t^TL&tabic— JttWiciij»u&t:mBfc&&tr>y y 9 

X\ m&<DLf*l*m&±m2>V¥&UJjV>$%:mT2>S 40 
y * f*x 4 - ^{ci^TUff y x Fccjjn^rfccfci^ 
fl&©«**flll»TlHf y^ F*^*fcBiI»Dl/T*>J: 

[002 7 } Xf*;7'2 1 4*Ctet,vcS»f y x Fteitf 
«K3n££. y'n^xy n-Bx-r ?y*2 l Otcg? 
>/^M^4i«$n/cl|^H ^2 1'6K: 50 



1 1 -2 37 9 8 9 

12 

fci^m>^->r^<D^x^^^f 3ft£ D es^>^* 

^ ;KE>SHtCC# ^r-; 7B. m 3 *#B5 L «c**6£lT 
yp-BX:r 7 7'2 1 0KK9. ^-cr^n^ ABSfr 

[0 02 8] mi£Ltc£oic. c ctcMm-fzmffi&m 

-CB, yy? F<D=i J: tfn jujfcy y ? 

F©P¥mo*«yy^ F<D»S?J:*3fe^WC^SaJfiB14 

tm^t^mztizm^tciz. yy? F#3>^-f^s 

*i&o fflKtD'n^'WJU* — '*^? F£igW£/c#\ C 
CD J: 5 tt ^ >/ w Ji/B. 7u y ^ A^(t(DSItf *tcr 
FJi/JHIH^Sttr*J:^k:tt**rjBBS-erfcJ:^. 
B3B, 3QBfc8SK:fi£o/cy y ? FCC**-*-* 

6) W$ ^ ^ 7*^iSt 7'p -fe x 7 a - * 5 B c 

f§yy? F4qHM3ti&. fcSSBB&ttTB. *^@?c 
jiEfiyy ? F#, ntf 'Jx h*3K#£ts, t^b^ 

yy ? F"C*oTfcJ:c^ c©flMc, *Hfi3feJHBtiy y 
? FB, 3MfyxF±©»J^ffl3>^^iU«FlB«:W-r 

2>yy? K-c*-9ttJ:i>. fiS«5feMiffiy y ? fob 

MB. H4«r*«8l/Sc*S6«r»ffl«:tt98-rs. 

[0029] xf77*30 2 r*w«jfeiB{ay y 9 

? f jwrk 3 >^ -y Ji/ 3 nti^#> £ 5 ^tcra l t mm 
wttsti*. siBfi^HEfiy y ^ f'b, S^OSSCCJ: 

yy ^ fwsht y^F^ciegsn/c^ 

(g^Hccy y ^ F«?^>;^j^ti4«^^ 
& 0 c<Dtab. ccr>y y ^ FBBJtc=3>/%v;u$nr*5 
0, si?f y^ F*»oiiLiapfr&c!)BB#pa*s3&i 

frZ>Z£frh. C(DJVv F*J*!fyx-h3^6l»*Sii 
Tt^tt(r^tettfe*&. ftMffllffi^y sp Ffe. cti 

if-^<-^»J^h«Wi:yy-; F*»iti*» 
alt WAByy^r F^H?f y X FSrflJ^f RCC3>^- 

-YJi/StiTfeO. ^-^^-xy^F^ig^^r^^/c 
&tcjBBf3n-ci>ac><b, *©yy ? fb-?- 
yx F*<D®iS«5tJKfi[yy ^ F<bLr»803ti4i* 
fcRtcn>/NV;l/3tiT(r^5pJ«B143&i*S 0 
[0 0 3 0 ] Xf77*30 4"C(D*(IBt* s , MflE^cllfilL 
yy ^ F^rocn>^V;i/3tiTi^ii/i5 4>cDr4>^ 
coyy v FBatottyx F, -rtttofeSHfy^ 

7 , at^7D-«Xf77'3 0 2K:I^ CCT 
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*Po/c<h«»r3*l/cJg^te, -^30 8t,Cte^Tm: 
[0 0 3 1] SKflBteJB&^V y F©3>/W^ 4 H 

[0 0 3 2 3 Wi&fctfftftStiT^fcate, -;7"3 

<Di*iBfct>fc^r«i«r*ci3&siwssn*. 

ocdx u ? FeXfTOflHflfttc-ts » h 

^*K7s*ts«*^*6*i5. 

[0 0 3 3 ] C<D»fjei*IH«*l£IB«:*{fc0 5*3&«. CO 

Bf3e«mttH»wcct«»5 y#\ rx = y#j r 
»i 0$ y#*»6#j2 005 ';#©igfflrtr, <t 

L/c#j2 0 0 5 y#«fc 0 fcfiC^nflWBBB»«trSC 

FOff3yHfll[*^:ttfl#(DV-X(ca^l*r^ 

[0 0 3 4] Xf^7*3 1 4fctet>TJ^EI$ratefrfc5 
«6K^3>^^^il/&C«F3ti/c». Xf 7 7*3 16m 

7'a-feX7D-«B2©^r v :/2 1 0 tc^tt 

4>, *<D^y ^ F^i*<DU^F^6»6n/c3tP{cj£i;T 

[0 0 3 5 ] BfS^B<DHICCa>^-r^I/^TL/n*Jtc 
7'ntX7D-«Xf';7'3 1 6^6Xr«;7' 

ttiie*£ 0 a C <h C> 5 *Hft 
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2. Claims 

What is claimed is: 

1 . A computer-implemented method for dynamically compiling methods during 
an idle period in the processing of a computer program, the computer-implemented 
method comprising: 

identifying the idle period; 

identifying a first method selected from a plurality of methods during the idle 
period, the plurality of methods being included in the computer program, wherein the . 
computer program is arranged to execute both interpreted p ro g ram code and compiled 
program code; and 

initializing a compilation of the first method, wherein the initialization of the 
compilation of the first method occurs during the idle period. 

2. A. computer-implemented method as recited in claim 1 wherein the plurality of 
methods is referenced in a first list associated with the computer program and the first 
method is a highest priority method associated with the first list 

3. A computer-implemented method as recited in claim I wherein a first set of 
methods selected from the plurality of methods is associated with a first list and a 
second set of methods selected from the plurality of methods is associated with a 
second list, the first list being created during the processing of the computer program 
the second list being created before the processing of the computer program, wherein 
identifying the first method includes: 

selecting the first method as a highest priority method from the first list 



(16) ftmW- 1 1 - 2 3 7 9 8 9 

iSf^ : P9 BBW- 0 0 6 ( 3/3 6) 

4. A computer-implemented method 35 recited in claim 1 wherein a first set of 
methods selected from the plurality of methods is associated with a first list and a 
second set of methods selected from the plurality of methods is associated with a 
second list, the first list being created during the processing of the computer program 
the second list being created before the processing of the computer program, wherein 
identifying the first method includes: 

selecting the first method as a highest priority method from the second list. 

5 . A computer-implemented method as recited in any one of the preceding 
claims farther including: 

determining whether an interrupt is received by the computer program after 
the initialization of the compilation of the first method; 

continuing the compilation of the first method for a predetermined period of 
time when it is determined that an interrupt has been received; 

determining whether the compilation of the first method is completed after the 
predetermined period of time; and 

aborting the compilation of the first method when it is determined that the 
compilation of the first method is not completed after the predetermined period of 
time. 

i 

6. A computer-implemented method for dynamically compiling methods during 
a period of low activity in the overall processing of a computer program, the 
computer-implemented method comprising: 

identifying the period of low activity; 
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identifying a first method selected from a plurality of methods during the 
period of low activity, the plurality of methods being included in the computer 
program; 

determining whether the first method is compiled, wherein the determination 
is made during the period of low activity; and 

initializing a compilation of the first method during the period of low activity 
when it is determined that the first method is not compiled. 

7. A computer-imp 1 em ented method as recited in claim 6 further incl udin g: 
identifying a second method selected from the plurality of methods during the 

period of low activity when it is determined that the first method is compiled; 

determining whether the second method is compiled, wherein the 
determination of whether the second method is compiled occurs during the period of 
low activity; and 

initializing a compilation of the second method during the period of low 
activity when it is determined that the second method is not compiled. 

8. A computer-implemented method as recited in one of claims 6 and 7 further 
including: 

detennining a priority value for each of the plurality of methods, wherein the 
first method is identified based on the priority value for the first method. 

9. A computer- implemented method as recited in claim 8 wherein detennining 
the priority value for each of the plurality of methods includes processing an 
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invocation counter associated with each of the plurality of methods during the period 
of low activity. 

10. A computer-implemented method as recited in claim 8 wherein determining 
the priority value for each of the plurality of methods includes estimating a 
compilation time for each of the plurality of methods during the period of low 
activity. 

11. A computer-implemented method as recited in claim 6 wherein a first set of 
methods selected from the plurality of methods is associated with a first list and a 
second set of methods selected from the plurality of methods is associated with a 
second list, the first list being created during the processing of me computer program 
the second list being created before the processing of the computer program, wherein 
identifying the first method includes: 

selecting the first method as a highest priority method from the first list. 

12. A computer-implemented method as recited in any one of claims 6-1 1 further 
including: 

determining whether a interrupt is received by the computer program after the 
initialization of the compilation of the first method; 

continuing the compilation of the first method for a predetermined period of 
time when it is determined that an interrupt has been received; 

determining whether the compilation of the first method is completed after the 
predetermined period of time; and 
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aborting the compilation of the first method when it is determined that the 
compilation of the first method is not completed after the predetermined period of 
time. 

13. A computer-implemented method as recited in claim 12 further including: 
completing the compilation of the first method when it is determined that an 

interrupt has not been received; 

identifying a second method selected from a plurality of methods during the 
period of low activity; 

determining whether the second method is compiled during the period of low 
activity; and 

initializing a compilation of the second method during the period of low 
activity when it is determined that the second method is not compiled. 

14. A computer-implemented method for dynamically processing delayed tasks 
during an idle period in the processing of a computer program, the computer- 
implemented method comprising: 

identifying the idle period in the processing of the computer program; 

identifying a first task selected from a plurality of tasks cfuring the idle period 
in the processing of the computer program, the plurality of tasks being included in the 
computer program, wherein the computer program is arranged to execute both 
interpreted program code and compiled program code; and 

starting the first task, wherein the starting of the first task occurs during the 
idle period. 
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15 . A computer-implemented method as recited in claim 1 4 further including 
completing the first task when an interrupt is received. 

16. A computer-implemented method as recited in claim 14 further including 
suspending the first task when an interrupt is received. 

17. A computer system for dynamically compiling byte-coded methods during a 
period of low activity in the processing of a computer program, the methods being 
associated with the computer program, the computer system comprising: 

a mechanism for identifying the period of low activity; 

a mechanism for identifying a first method selected from a plurality of 
methods during the period of low activity; and 

a compiler for initializing a compilation of the first method during the period 
of low activity. 

18. A computer system as recited in claim 17 further including: 

a first list arranged to reference a first set of the plurality of methods, wherein 
the first list is associated with the computer program and the first method is a highest 
priority method associated with the first list; and 

a second list arranged to reference a second set of the plurality of methods, 
wherein the second list is created before the processing of the computer program and 
the first list is created during the processing of the computer program. 
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19. A computer system as recited in claim 17 farther including: 

an interrupt processor arranged io receive an interrupt signal during the 
compilation of the first method, the interrupt processor being in communication with 
the compiler, wherein the compiler is further arranged to continue the compilation of 
the first method for a predetermined period of time in response to a signal from the 
interrupt processor; and 

an aborting mechanism, the aborting mechanism being in communication with 
the compiler, wherein the aborting mechanism is arranged to abort the compilation of 
the first method. 

20. A computer system as recited in any one of claims 17-19 further including: 

a diagnostic mechanism, the diagnostic mechanism being arranged io identify 
when the first method is compiled. 

21. A computer-readable medium including computer program code devices 
arranged to dynamically compile methods during an idle period in the processing of a 
computer program, the computer-readable medium comprising: 

computer program code devices that identify the idle period; 

computer program code devices that identify a first method selected from a 
plurality of methods during the idle period, the plurality of methods being included in 
the computer program; and 

computer program code devices that initialize a compilation , of the first 
method during the idle period. 
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22. A computer-readable medium as recited in claim 22 wherein the computer 
program code devices are embodied in a carrier wave. 
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3 • Detailed description of Invention 

BACKGROUND OF THE INVENTION 
t. Field of Invention 

■. The present invention relates generally to methods and apparatus for 
optimizing the execution of software applications. More particularly, the present 
invention relates to methods and apparatus for performing compilations or other 
activities du ri n g pauses in the overall execurian of a computer program to optimize 
the use of computer system resources. 

2. Description of Relevant Art 

Computer systems are often linked across a network, e.g., local area networks, 
intranets and internets, of computer systems such that they may share resources such 
as software applications. In general, software applications, or computer programs, 
may be delivered in different formats to different computer systems, due to the fact 
that each computer system requires software applications to be in a specific format. 
Alternatively, the computer programs may be delivered to a computer system in a 
machine-Ladep endent form, i.e., as byte codes, in order to enable one form of a 
computer program to be utilized by many different computer systems. 

When computer programs are delivered in a machine-independent form, the 
programs may be interpreted directly, or the programs may be translated into 
machine-dependent code, i.e., "machine code." Pro gram s which are interpreted 
directly occupy less space in a computer system than programs which are translated 
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into machine code. However, programs which are interpreted directly have slower 
execution speeds than programs which are translated into machine code, in most 
cases. As such, the determination of whether or not to interpret a computer program 
directly, in lieu of translating the computer program into machine code, is often based 
on the relative importance of space in relation to execution speed. 



One approach to compilation is to compile methods within a program that is 
actively executing when they are first called for execution. This approach is 
frequently referred to as either dynamic or "nmtime" compilation. One problem with 
dynamic compilation is that the compilation overhead associated with the program 
may become excessive. That is, when a relatively large number of methods must be 
compiled at about the same time, the overhead associated with the compilation of the 
program may be at a level that adversely affects the overall execution of the program. 
In general, an overuse of system resources for compilation may lead to a less 
efficient, slower execution of the program. In addition, the time consumed by a 
compiler which is compiling methods during active program execution may introduce 
user-visible pauses into the execution of the program. By way of example, when a 
user inputs a command into the program while the compilation overhead of the 
program is high, there may be a delay in the response to the user input. Such delays 
in response may be annoying to a user. Therefore, mechanisms that improve the 
apparent efficiency of dynamic compilation of methods in a computer program would 
be desirable. 
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SUMMARY OF THE INVENTION 

To achieve the foregoing and other objects of the invention, methods and 
apparatus for dynamically compiling methods during idle periods in the execution of 
a computer program are disclosed. The described methods are particularly suitable 
for use in computer systems that are arranged to execute both interpreted and 
compiled byte codes. According to one aspect of the present invention, an idle or low 
overhead period in the processing of a computer program is identified. One or more 
methods that have been identified for compilation are then dynamically compiled 
during the identified idle period In some embodiments, methods to be dynamically 
compiled are referenced in one or more lists. The lists may be prioritized to facilitate 
the compilation of the highest priority methods first. En one embodiment, a pair of 
compilation lists are provided with a first one of the compilation lists being a. database 
list created prior to processing the computer program while the other being an 
execution list created during the processing of the computer pro g ram. 

In one embodiment, if an interrupt is received during the compilation of a 
method, the compilation is allowed to continue for a predetermined period of time. If 
the compilation is not completed during the predetermined period of time, then the 
compilation is aborted. 

1 

According to still another aspect of the present invention, a computer system 
for dynamically compiling byte-coded methods during a period of low activity in the 
processing of a computer program includes a mechanism for identifying a period of 
low activity. The system further includes a mechanism for identifying a method for 
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compilation during the period of low activity. A compiler is arranged to initialize a 
compilation of the identified method during the period of low activity. In one 
embodiment, the system also includes an interrupt processor which is arranged to 
handle interrupt signals received during the compilation of the identified method, and 
an aborting mechanism which aborts the compilation of the method when necessary. 

These and other advantages of the present invention will become apparent 
upon reading the following detailed descriptions and studying the various figures of 
the drawings. 

The invention may best be understood by reference to the following 
description taken in conjunction with the accompanying drawings. 
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DETAILED DESCRIPTION OF THE EMBODIMENTS 

As described above, the dynamic compilation of methods associated with a 
byte-coded program while the program is actively executing may cause the program 
to execute inefficiently. This inefficiency may be a result of an excessive use of 
available, computer system resources by the compiler, or compilation overhead. The 
time consumed by a compiler that is dynamically compiling methods during active 
program execution may introduce delays into the execution of fee program. When 
such delays are perceptible to a user, the delays may be considered to be 
unacceptable, especially when the length of a delay is relatively long, e.g., more than 
approximately 200 milliseconds. 

* t 

One approach to improving the performance of such programs is to permit the 
mixing of both interpreted and dynamically compiled byte codes. Within such a 
system, decisions must still be made as to when it is efficient to compile a particular 
method. Li the present invention, method and an apparatus are described for delaying 
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the dynamic compilation of methods in a computer program when compilation 
overhead is relatively high. More specifically, when it is determined that compilation 
overhead is too high, the dynamic compilation of at least some of the methods may be 
delayed unril there are periods of relatively lower activity in the overall processing of 
the program. 

By delaying the dynamic compilation of at least some byte-coded methods 
which are slated for compilation, computer resources may be more efficiently 
utilized. While a computer program is essentially inactive during processing, e.g., 
when the computer program is idle while awaiting. input from a user, the overall 
resource utilization overhead associated with the execution of the program is 
generally relatively low. During such periods of low activity, available system 
resources may be used to perform compilations of methods which have previously 
been identified as being methods which are to be compiled. Performing compilations 
while the computation overhead of the computer program is low allows for the 
efficient usage of overall system resources and, typically, does not cause delays which 
are noticeable to a user. 

With initial reference to Figure l r a computer system which allows byte codes 
to be dynamically compiled will be described in accordance with an embodiment of 
the present invention. Byte codes 144 are provided as input to a computer system 146 
at run-time. Byte codes 144, which may generally be organi2ed as a computer 
program, are typically arranged in parseable segments such as methods, or routines. 
In one embodiment, byte codes 144 may be provided by a compiie-timc environment 
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within a virtual machine to a run-time environment, e.g., computer system 146, within 
the same virtual machine. One suitable virtual machine oh which the present 
invention may be implemented will be discussed below in more detail with respect to 
Figure 6. 

When byte codes 144 are provided to computer system 146, byte codes 144 
may be processed with an interpreter 148. Alternatively, byte codes 144 may be 
compiled by a compiler 150 to produce compiled byte codes 1 52. It should be 
appreciated that byte codes 144 may generally be inputted to both interpreter 148 and 
compiler 150 for processing, substantially simultaneously. 

Each time a method is invoked, if the method is not compiled, byte codes 144 
associated with the method are interpreted using interpreter 148. In one embodiment, 
a measure of how many times a method is interpreted is maintained. Such measures 
may include a counter, e.g. t an invocation counter, which is included in each 
interpreted method, and is incremented each time the method is interpreted. 

When the number of times a method is interpreted exceeds a threshold, i.e. , a 
limiting value, the method may be compiled using compiler 150. Repeatedly 
interpreting a method, which is included in frequently executed code 158, may be 
inefficient, as interpreted byte code 154 generally executes slower, or less efficiently, 
than compiled code. Compiling frequently executed code 158 generally may allow 
methods embodied in frequently executed code 158 to be executed more efficiently, 
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as tune-savings gained by compiling the method is likely to compensate for the 
compilation overhead associated with the compilation process. 

During run-time, the compilation overhead associated with compiling byte 
codes 144 using compiler 150 is monitored to ensure that the compilation overhead 
does not exceed a typically predetermined maximum acceptable level. The 
compilation overhead is often expressed in terms of the percentage of processor time 
required for compilation as opposed to execution. The predetermined maximum 
overhead level may be widely varied depending on the needs and characteristics of a 
particular system. By way of example, for a virtual machine intended to provide high 
execution performance, the predetermined maximum level may be within the range of 
approximately 1 0 percent to approximately 30 percent usage of the overall system 
resources. When the overhead associated with the compilation of byte codes 144 
exceeds the predetermined maximum level, then methods which would be compiled if 
the compilation overhead were lower may be placed in an execution list, or queue. 
This execution list is essentially a waiting list of methods which may be processed 
when the compilation overhead is lower, i.e., methods in the execution list may be 
compiled when the compilation overhead is lower. Specifically, the execution list 
may be processed at times when both the compilation overhead, as well as the overall 
computation overhead associated with computer system 146, are at a low level. 

When byte codes are to be compiled during otherwise idle periods in the 
overall execution of a program, e.g., during idle periods which occur throughout the 
processing of byte codes, the program may be monitored to determine when pauses 
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occur. Referring next to Figure 2, a process of executing a program, or an 
application, which includes the capability of compiling code during pauses will be 
described in accordance with an embodiment of the present invention. The execution 
of a program begins at step 210, and in step 212, a determination is made regarding 
whether the execution of the program has reached an idle period. 

An idle period is generally a pause, e.g., a think pause, in the processing of the 
program during which the program is essentially inactive. The program may be 
awaiting an action such as a timer signal from the associated operating system, or the 
program may be awaiting a user input, prior to actively continuing execution. In 
general, a think pause occurs while the program is awaiting an action from a user. It 
should be appreciated that the length of an idle period may vary widely. By way of 
example, the length of an idle period may vary from very few milliseconds to 
approximately half a second. When an idle period occurs because a program is 
awaiting input from a user, the idle period may generally be much longer, as for 
example on the order of a number of seconds, minutes, days or more. 

In general, a threshold value is used to recognize a "useful" pause. For 
example, if the actual pause has lasted for a predetermined number of milliseconds, 
then the system may recognize the pause as a useful pause which is likely to continue 
for a whole longer. When the pause is likely to continue, then compilations may be 
allowed to continue in order to exploit the.pause. As such, the determination in step 
212 regarding whether the execution of the program has reached an idle period 
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involves determining whether a period of low activity has reached a threshold value, 
e.g., approximately 1 00 milliseconds or approximately half a second 

In general, the occurrence of an idle period, or period of relatively low 
activity, may be identified by monitoring the usage of the central processing unit 
(CPU) associated with the execution of the program. Alternatively, the existence of 
an idle period may be determined by monitoring the status of threads associated with 
the overall computer system. 

When CPU usage is monitored to identify periods of relative inactivity, CPU 
usage is essentially monitored to determine when the CPU usage rails below a certain 
usage threshold. The usage threshold, i.e., a " low activity threshold," may be widely 
varied. By way of example, the usage threshold may be set such that when 
substantially only activities with low overhead, such as setting a cursor to periodically 
blink, are running, the p iugia m is considered to be idle. In one embodiment, when 
CPU usage during the processing of the program falls below a usage threshold which 
is approximately 20 percent of the overall system resources, then the overall 
processing of the program is considered to be in a period of low activity. At such 
times, at least approximately 80 percent of the system resources may be available for 
use. 

Monitoring the status of threads may involve studying a thread scheduler, as 
will be appreciated by those skilled in the art. When the thread scheduler indicates 
that all threads are blocked, Le. 9 substantially none of the threads are in a "run-able" 
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state, then the implication is that the program is not consuming CPU time. CPU time 
will generally not be consumed until a signal arrives, at which point a thread may 
become unblocked. When CPU time is not being consumed, then the program is 
generally in an idle period. 

If it is determined in step 2 1 2 mat the execution of the program is not in an 
idle period, then process flow returns to step 210 where the program continues to 
execute. If, instead, it is determined in step 212 that there is an idle period, a 
determination is mnrin in step 214 regarding whether there are any pending tasks, as 
for example compilations. That is, a determination is made regarding whether there 
are any tasks which are slated to occur during idle periods. The tasks may generally 
include a wide variety of tasks, as for example compilations and garbage collection. 
Such tasks may be prioritized in terms of their relative importance within a system. 
In the described embodiment, the tasks will be described in terms of pending 
compilations. 

Pending compilations may generally be obtained from two sources, a datab ase 
list and an execution list, which are lists of 'candidate* 1 methods for compilation. 
One arrangement for creating a database list may involve a system which monitors 
compiled methods, such as an arrangement for creating a database list when a 
database is inlined. In such a system, the database list is essentially a "working set," 
or a " candidate set/* of methods which were compiled during a previous execution of 
the program, and are considered as methods that are likely to be compiled in a 
subsequent execution of the program. Other mechanisms may be used to create or 
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add to a database lis: as well. It should be appreciated tot in some embodiments, the 
database list may include other tasks such as the performance of garbage collection. 

An execution list, as mentioned above, is a queue of methods, or a candidate 
set of methods, which is created during the current execution of the program. The 
execution list may contain, or identify, methods which were suppressed from 
compilation due to the fact that the compilation overhead was previously considered 
to be too high to allow the methods to be compiled. The execution list may also 
identify methods which were periodically added to the list by a separate sweeper 
process which studies the invocation counters, i.e., counters which track the number 
of times a method has been interpreted, associated with interpreted methods. In 
general, the invocation counter for a method is incremented each time the method is 
invoked. The sweeper may periodically study invocation counters to determine if 
invocation counters of methods which have not been recently invoked are at a level 
which is currently considered to deem the method as appropriate for compilation. 
Since the threshold, e.g. , the number of invocations of a method which must generally 
be reached in order for the method to be considered for c omp ilation, may vary during 
program execution, methods with invocation counters that are over a current threshold 
may be added to the execution list by the sweeper. Other mechanisms may be used to 
create or add to the execution list as well. In some embodiments, the execution Eat 
may be associated with a general work list which includes pending compilations in 
addition to other pending tasks, e.g., garbage collection. 
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When it is determined through studying the execution list and the database list 
in step 214 that there are no pending tasks, then process flow returns to step 210 in 
which the program continues to execute. When, on the other hand, it is determined 
that there are pending compilations, then in step 216, the tasks, e.g., compilations, are 
performed. The steps associated with performing the pending compilations will be 
described below with reference to Figure 3. After pending compilations are 
performed, process flow returns to step 210 in which the program continues to 
execute. 

As previously mentioned, in the described embodiment, a method is compiled 
when it is anticipated that compiling the method and invoking the compiled method is 
likely to be more efficient than interpreting the method. Such compilations may be 
delayed until there are idle periods during the execution of the overall program, in 
order to avoid excessive compilation overhead. Figure 3 is a process flow diagram 
which illustrates the steps associated with p erforat ing delayed compilations on 
methods, Le.. step 216 of Figure 2, in accordance with an embodiment of the present 
invention. The process of performing compilations begins at step 302 where the 
candidate method with the highest priority is identified. In one embodiment, the 
highest priority method may be the method with the highest number pf invocation 
counts in, or identified by, the execution list. Alternatively, the highest priority 
method may be the method with the shortest anticipated compilation time on the 
execution list. The identification of the highest priority method will be discussed in 
more detail below with reference to Figure 4. 
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After the highest priority method is identified in step 302, a determination is 
made in step 304 regarding whether the highest priority method has already been 
compiled. The highest priority method may already be compiled for a variety of 
different reasons. By way of example, after the method is placed in the execution list, 
during the course of overall program execution, the method may be invoked and 
compiled while compilation overhead is low. As such, the method is already 
compiled, and may not have been removed from the execution list, as repeatedly 
updating the execution list is expensive. The highest priority method may also be 
previously compiled if the method is obtained from the database list That is, when 
the same method ap p ear s in both the execution list and the database list, if the method 
was already compiled using the execution list, for example, and the database list is 
not updated due to high costs, men the method may already be compiled when it is 
identified as the highest priority method in the database list 

When the determination in step 304 is that the highest priority method is 
already compiled, then the method may be removed from the appropriate list, i.e., 
either the execution list or the database list, and process flow returns to step 302 
where a new highest priority method is identified. If, instead, it is determined that the 
highest priority method has not been previously compiled, then in ste^p 306, the 
compilation of the highest priority method begins. That is, the compilation of the 
highest priority method is initialized. 

During the compilation of the highest priority method, interrupts may be 
received. In general, interrupts may include, but are not limited to, timer si gnals and 
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user inputs, e.g., keyboard inputs. It is determined in step 308 whether an interrupt 
has been received. As will be appreciated by those skilled in the art, when an 
interrupt is received, the compilation of the highest priority method may 
automatically cease in order for the interrupt to be processed as necessary. 

If an interrupt has been received, then the compilation of me highest priority 
method is allowed to continue for a predetermined period of time in step 314. The 
predetermined period of time is, in one embodiment, essentially a " time to live" for a 
compilation after a signal has been received that will set at least one thread in a run- 
abie state. By allowing the compilation to continue briefly after an interrupt is 
received, the compilation is given a chance to be completed, in the event that the 
compilation is close to completion. 

Although the predetermined period of time may be widely varied, the 
predetermined period of time is generally a number of milliseconds, e.g. , " X 
milliseconds." Shorter periods of time in the range of approximately 1 0 milliseconds 
to approximately 200 milliseconds are preferred, since it has been observed that 
delays of time of greater than approximately 200 milliseconds in response to user 
input are perceptible and, hence, often annoying to a user. The period of time may be 
varied based on the source of the signal or the priority of the threads in a run-able 
state, with shorter periods being used for higher-priority signals or threads. 

After the compilation is allowed to continue for the predeterrnined period of 
time in step 3 14, a detennination is made in step 3 16 regarding whether the 
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compilation has been successfully completed during the predetermined period of 
time. If the compilation has been completed, then process flow moves to step 2 10 of 
Figure 2, where the overall execution of the program continues. It should be 
appreciated that once the compilation is completed, the newly compiled method will 
also be removed from either the execution list or me database list, depending upon 
which list the method was obtained from. 

When the compilation is not completed during the predetermined period of 
time, then process flow moves from step 3 1 6 to step 3 1 8 in which the compilation is 
aborted. The compilation is not allowed to be completed due to the fact that allowing 
the compilation to be completed may result in a significant delay in the execution of 
the overall program or, more specifically, the processing of the interrupt. When the 
compilation is aborted, "clean up" occurs, e.g., system resources used in the 
attempted compilation are relinquished, as will be understood by those skilled in the 
art. Once the compilation is aborted, process flow moves to step 21 0 of Figure 2, in 
which the overall execution of the program corithiues. 

Returning to step 308, in the event that no interrupt has been received during 
the compilation of the highest priority method, the compilation continues in step 310. 
A deterrnination is made in step 312 regarding whether the compilation has been- 
completed. If it is determined that the compilation has been completed, the highest 
priority method may be removed from the appropriate list, and process flow returns to 
step 302 in which a new highest priority method is identified. Alternatively, if it is 
deterrniried in step 312 that the compilation has not been completed, then the 
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compilation is allowed to continue until cither it is completed, or it is aborted due to 
the receipt of an interrupt in step 308. 

In general, the "order" in which methods in an execution list and a database 
list are compiled may be determined based upon a number of different factors. The 
methods in each list may be assigned priority values relative to other methods in the 
same list. The priority values may generally be assigned at any time during the 
overall execution of the program, and may further be updated throughout the course 
of program execution. By way of example, the priority values in a list may be 
computed and updated, i.e. t re-evaluated, each time a method is added to the list 
Priority values may also be re-evaluated at the begmning of each idle period to ensure 
that the priorities of methods in the execution list and the database list are c urrent at 
the time methods are chosen for compilation. 

The priority value of a method may be calculated based on any combination of 
factors including, but not limited to, the invocation count of the method, the position 
of the method within the list, the estimated compilation time of the method, and the 
length of the current idle period during the overall execution of the program. 
Alternatively, in one embodiment, the priority value of a method may essentially be 
assigned randomly. 

The method which has the highest invocation count in a list may have the 
highest compilation priority, as it is essentially the most frequently invoked 
interpreted method. The position of a method within a list may also affect the priority 
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value assigned to the method, since the method most recently added to the list is often 
likely to be needed in the immediate future. The method which has the shortest 
estimated compilation time in a list may have the highest compilation priority, since 
the compilation of a method with a shorter estimated compilation time is generally 
more likely to be completed during an idle period than the compilation of a method 
with a longer estimated compilation time. In general, the compilation time of a 
method may be estimated by the length of the method, e.g., a relatively short method 
will typically have a relatively short compilation time. 

The length of the current idle period may also affect the priority value of a 
method. For example, if the current idle period has already been relatively long, then 
the likelihood that the idle period will last longer is generally increased. Long idle 
periods may often be a result of a user leaving the computer on which the overall 
execution of the program is occurring for a prolonged period of time. As such, it has 
been observed that when it is determined that a current idle period has already been 
relatively long, the likelihood that the idle period will last even longer is generally 
reasonably high. Therefore, when an idle period is expected to be relatively long, 
methods with longer expected compilation times may have higher compilation 
priorities, since methods with shorter expected compilation times may typically be 
readily compiled during subsequent shorter idle periods. 

As previously mentioned, die priority value of a method may be based on a 
number of different factors. In other words, a priority function may be used to 
determine apriority value. The form of such a priority function may generally be 
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widely varied. By way of example, a priority function may divide the invocation 
count for a method by the estimated compilation time for the method in order to 
obtain a priority value for the methocL Alternatively, a priority function may involve 
using the invocation count for methods with shorter estimated compilation times and 
using the invocation count divided by a constant for methods with longer estimated 
compilation times. 

Referring next to Figure 4, the steps associated with identifying the method 
with the highest priority value, i.e., step 302 of Figure 3, will be described in 
accordance with an embodiment of the present invention. The identLfication of the 
method with the highest priority begins at step 402 with a determination of whether 
any methods are present in the execution list associated with the program. 

In general, methods in an execution list are considered as having compilation 
priorities that are higher than those of methods in a database list Methods in the 
execution list are methods that have been identified during the course of program 
execution as being likely to overcome the associated compilation overhead by 
executing more efficiently, because the methods are repeatedly invoked. 
Alternatively, methods in the database list are methods which may potentially be 
repeatedly invoked and, hence, compiling the methods is likely to be beneficial. In 
other words, the execution list reflects the current, or actual, usage of methods, while 
the database list essentially reflects long-term usage of methods. Therefore, methods 
from the execution list are typically chosen for compilation before methods from the 
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database list, since compiling the methods in the execution list is more likeiy to lead 
to a more efficient overall execution of the program which uses the methods. 

If the determination in step 402 is that there are methods in the execution list, 
then in step 404, the method with the highest priority in the execution list is selected 
for compilation. Once the method is selected from the execution list, then the process 
of identifying the highest priority method is completed. Alternatively, if the 
detennination in step 402 is that there are no methods in the execution list, then the 
highest priority method in the database list is selected for compilation. After the 
method is selected from the database list, then the process of identifying the highest 
priority method is completed. 

The present invention may generally be implemented on any suitable 
computer system. Specifically, the compilation of queued methods during idle 
periods in the overall execution of a program may be accomplished using any suitable 
virtual machine, such as the virtual machine described below with respect to Figure 6. 
Figure 5 illustrates a typical, general purpose computer system suitable for 
implementing the present invention. The computer system 530 includes any number 
of processors 532 (also referred to as central processing units, or CPUs) that are 
coupled to memory devices including primary storage devices 534,(,typically a read 
only memory, or ROM) and primary storage devices 536 (typically a random access 
memory, or RAM). 
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Computer system 530 oi, more specifically, CPU 532, maybe arranged to 
support a virtual machine, as will be appreciated by those skilled in the art One 
example of a virtual machine that is supported on computer system 530 will be 
described below with reference to Figure 6. As is well known in the ait, ROM acts to 
transfer data and instructions uru-directianally to the CPU 532, while RAM is used 
typically to transfer data and instructions in a bi-directional manner. CPU 532 may 
generally include any number of processors. Both primary storage devices 534, 536 
may include any suitable computer-readable media. A secondary storage medium 
538, which is typically a mass memory device, is also coupled bi-directionally to 
CPU 532 and provides additional data storage capacity. The mass memory device 
538 is a computer-readable medium that may be used to store programs including 
computer code, data, and the like. Typically, mass memory device 538 is a storage 
medium such as a hard disk or a tape which is generally slower than primary storage 
devices 534, 536. Mass memory storage device 93 S may take the form of a magnetic 
or paper tape reader or some other well-known device. It will be appreciated that the 
information retained within the mass memory device 538, may, in appropriate cases, 
be incorporated in standard fashion 95 part of RAM 534 as virtual memory. A 
specific primary storage device 536such as a CD-ROM may also pass data uni- 
directionally to the CPU 532. 

CPU 532 is also coupled to one or more input/output devices 540 that may 
include, but are not limited to, devices such as video monitors, track balls, mice, 
keyboards, microphones, touch-sensitive displays, transducer card readers, magnetic 
or paper tape readers, tablets, styluses, voice or handwriting recognizers, or other 
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well-known input devices such as, of course, other computers. Finally, CPU 532 
optionally may be coupled to a computer or telecommunications network, e.g., a local 
area network, an internet network or an intranet network, using a network connection 
as shown generally at 512. With such a network connection, it is contemplated that 
the CPU 532 might receive information from the network, or might output 
information to the network in the course of performing the above-described method 
steps. Such information, which is often represented as a sequence of instructions to 
be executed using CPU 532, may be received from and outputted to the network, for 
example, in the form of a computer data signal embodied in a carrier wave. The 
above-described devices and materials will be familiar to those of skill in the 
computer hardware and software arts. 

As previously mentioned, a virtual machine may execute on computer system 
530. Figure 6 is a diagrammatic representation of a virtual machine which is 
supported by computer system 530 of Figure 5, and is suitable for implementing the 
present invention. When a computer program, e.g , a computer program written in the 
Java™ programining language developed by Sun Microsystems of Mountain View, 
California, is executed, source code 61 0 is provided to a compiler 620 within a 
compile-time environment 605. Compiler 620 translates source cods 610 into byte 
codes 630. In general, source code 610 is translated into byte codes 630 at the time 
source code 61 0 is created by a software developer. 

Byte codes 630 may generally be reproduced, downloaded^ -or otherwise 
distributed through a network, e.g., network 512 of Figure 5, or stored on a storage 
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device such as primary storage 534 of Figure 5. In the described embodiment, byte 
codes 630 are platform independent. That is, byte codes 630 may be executed on 
substantially any computer system that is running a suitable virtual machine 640. By 
way of example, in a Java™ environment, byte codes 630 may be executed on a 
computer system that is Tunning a Java™ virtual machine. 

Byte codes 630 are provided to a runtime environment 635 which includes 
virtual machine 640. Runtime environment 635 may generally be executed using a 
processor such as CPU 532 of Figure 5. Virtual machine 640 includes a compiler 
642, an interpreter 644, and a runtime system 646. Byte codes 630 may generally be 
provided either to compiler 642 or interpreter 644. 

When byte codes 630 are provided to compiler 642, methods contained in byte 
codes 630 are compiled into machine instructions, as described above. On the other 
hand, when byte codes 630 axe provided to interpreter 644, byte codes 630 are read 
into interpreter 644 one byte code at a time. Interpreter 644 then performs the 
operation defined by each byte code as each byte code is read into interpreter 644. In 
general, interpreter 644 processes byte codes 630 and performs operations associated 
with byte codes 63 0 substantially continuously. 

When a method is called from an operating system 660, if it is determined that 
the method is to be invoked as an interpreted method, runtime system 646 may obtain 
the method from interpreter 644. If, on the other hand, it is determined that the 
method is to be invoked as a compiled method, runtime system 646 activates 
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compiler 642. Compiler 642 then generates machine instructions from byte codes 
630, and executes the machine-language instructions. In general, the machine- 
language instructions are discarded when virtual machine 640 terminates. 

Although only a few embodiments of the present invention have been 
described, it should be understood that the present invention may be embodied in 
many other specific forms without departing from the spirit or the scope of the 
invention. By way of example, steps involved with performing a compilation during 
an idle period may be reordered, removed or added. In general, steps involved with 
the methods of the present invention may be reordered, removed, or added without 
departing from the spirit or the scope of the present invention, 

A highest priority method for compilation has been described as being 
selected out of substantially all methods in an execution list and a database list. 
Searching all methods in an execution list or a database list, or both, to locate the 
method with the highest compilation priority may prove to be expensive in the event 
that the execution list is extensive. Therefore; in one embodiment, a subset of the 
execution list may be searched, in lieu of substantially the entire execution list, to 
identify a highest priority method for compilation may. By way of example, the first 
"N" candidate methods from the execution list may be searched to identify the 
highest priority method in the first N candidate methods. 

As previously mentioned, a compilation priorities of methods may be 
identified, at least in part, using the invocation counters. The invocation counters are 
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generally counters which are incremented each time a method is accessed It should 
be appreciated that in some embodiments, invocation counters may be decayed over 
time. For example, if a method was repeatedly invoked and slated for compilation at 
the beginning of program execution, but is never again invoked, the invocation 
counter may be decayed to reduce the compilation priority of the method. Once the 
invocation counter for a method has been decayed, e.g., exponentially decayed, 
compiling the method may no longer be advisable. As such, such methods may be 
periodically removed from the execution list 

Similarly, during the course of performing compilations, a determination is 
made regarding whether a method which is slated for compilation has previously been 
compiled. Alternatively, methods which have already been compiled may be 
removed as appropriate from either or both the execution list and the database list. In 
general, the overhead associated with checking the execution list and the database list 
for compiled methods may be relatively significant. However, compiled methods 
may be periodically removed, as for example at the beginning of an idle period, 
without departing from the spirit or the scope of the present invention. 

Although an execution list has generally been described as being a list, or 
queue, of interpreted methods which are to be compiled, the execution list may also 
include compiled methods which are delayed from being re-compiled until there is an 
idle period For example, in a system with two levels of compilers, once a method is 
compiled, if that method is repeatedly executed, it may prove to be desirable for the 
method to be re-compiled more efficiently. In such a system, the methods slated for 
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re-compilations, or secondary compilations, may be included in the same execution 
list as interpreted methods which arc slated for compilation. However, the methods 
slated for re-compilations may, on the other hand, be included in a separate execution 
list 

In one embodiment, the execution list may generally be a work list which 
includes delayed tasks, in addition to, or in lieu o£ pending compilations. Such tasks 
may be prioritized. It should be appreciated that when a task from the work list is 
running, if an interrupt is received, the tad: may be allowed to be completed. By way 
of example, if the task involves garbage collection, suspending a garbage collection 
process and " backing out" of the garbage collection process maybe as costly, if not 
more costly, than completing the process. As such, the garbage collection may be 
allowed to be completed Tasks may also generally be suspended when an interrupt is 
received. Therefore, the present examples arc to be considered as illustrative and not 
restrictive, and the invention is not to be limited to the details given herein, but may 
be modified within the scope of the appended claims along with their full scope of 
equivalents. 
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4. Brief Description o£ Drawings 

Figure 1 is a block diagram representation of a comp uter system which 
dynamically compiles code in accordance with an embodiment of the present 
invention. 

Figure 2 is a process flow diagram which illustrates the steps associated with 
executing a program which includes the capability of compiling code during pauses in 
accordance with an embodiment of the present invention. 

Figure 3 is a process flow diagram which illustrates the steps associated with 
performing compilations on methods, i.e., step 216 of Figure 2, in accordance with an 
embodiment of the present invention. 

Figure 4 is a process flow diagram which illustrates the steps associated with 

identifying the highest priority method, step 302 of Figure 3, in accordance with 

an embodiment of the present invention- 
Figure 5 illustrates a typical, general purpose computer system suitable for 

implementing the present invention. 

Figure 6 is a diagrammatic representation of a virtual machine which is 

suitable for implementing the present invention. 
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1 . Abstract 



Methods and apparatus for dynamically compiling byte codes associated with 
methods during idle periods in the execution of a computer program are disclosed. 
The described methods are particularly suitable for use in computer systems that are 
arranged to execute both interpreted and compiled byte codes. In some embodiments, 
methods to be dynamically compiled are referenced in one or more lists. The lists 
may be prioritized to facilitate the compilation of the highest priority methods first. 
In one embodiment, a pair of compilation lists are provided with a first one of the 
compilation lists being created prior to processing the computer program while the 
other is created during the processing of the computer program. 

2 - Representative Drawing 



Fig. 2 



